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DETAILED ACTION 
Response to Arguments 

Applicant's arguments with respect to claims have been considered but are moot 
in view of the new ground(s) of rejection. 

U.S. Patent 6,721 ,490 has been recited to teach on the fly indexing. 

Claim Rejections - 35 USC § 103 

The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 1 02 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

2. Claims 1-5, 10-13 and 15 rejected under 35 U.S.C. 103(a) as being 
unpatentable over Yeo (US Pat No. 6,71 1 ,741 ) in view of Yao (US Pat No. 6,721 ,490). 

Regarding claim 1 , Yeo discloses a method for providing client-side indexing and 
navigation of video data comprising the steps of: 

opening a main connection 324 for a client-side device to receive transmissions 
of a data flow, wherein said data flow is not indexed (column 3, lines 48-50); 

opening a second connection for the client side device to receive at least one 
look-x data stream 322 comprising a plurality of data from said data flow wherein said 
plurality of data is not indexed '(column 3, lines 48-50, indexing is preformed via display 
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organizer 508 located witiiin user ternninal 102, colunnn 4, lines 13-26, column 6, lines 6- 
18), 

indexing with the client side device at least one point of the look-x data stream to 
at least one corresponding point in said dataflow (organizer 508 creates the index 
locally from time stamped data for the corresponding temporal snapshots, column 4, 
lines 13-26. 43-58, column 5, line 56-column 6, Iine18) , wherein said indexing step with 
the client-side device further comprises selecting at lease one look-x point for display to 
represent the at least one corresponding pointer in said data flow at a particular 
timeframe In the data flow (figures 6a/b, column 4, line 43-65), and 

providing control of a playback position of said data flow based on the indexed 
points in the look-x data stream (figures 6a/b, column 4, line 43-65). 

Yeo fails to teach on the fly indexing. 

Yao discloses a client side indexing system which records the position in a 
program where a user has indicated playback, stop or shifting in time forwards or 
backwards, and later presents these points to the user in order to easily navigate the 
program (column 4, lines 1-67, column 22, line 1-50, figures 25-27). 

Therefore, it would have been obvious to one skilled in the art at the time of 
invention to modify Yeo to utilize the client side on the fly indexing as taught by Yao. for 
the advantages of making it easy to navigate through a video stream based off a users 
past behaviour. 
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Regarding claims 2, 12, Yeo discloses displaying a timeline corresponding to the 
indexed look-x points, the timeline having at lease one of said indexed look-xpoints 
displayed so as to reference a position on said timeline (figure 6a, position 602-610, 
each of which is at a corresponding time interval). 

Regarding claims 3, 1 1 , the claimed step of displaying at least one of a skip 
foHA/ard and a skip backward button configured to step a play position of the data flow to 
a position corresponding to a respective one of a next and a previous look-x data points 
relative to the current play position of the data flow is met by column 5,. lines 1-3, 
wherein Yeo teaches the use of options within the media player 612 to step to the 
previous frame or the next frame, so as to allow the user to step through the playback 
sequence. 

Regarding claim 4, Yeo discloses in figure 6a, a timeline corresponding to a 
number of look-xpoints with images representing each point (602-610), a user selects a 
point and the corresponding time is displayed (column 4, lines 59-64). 

Regarding claim 5, Yeo discloses the flow being a video and look-x points being 
frames of the data flow and being retrieved from the main connection or the second 
connection (column 3, lines 48-50), source video frames 106 (the video) being sent on 
the main data path 324, and temporal snapshots (the look-x points/frames) being sent 
on a second data path 322. 
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Regarding claim 10, Yeo discloses a device 102 for client-side indexing 
comprising: 

A video player 102 comprising: 

a client side main data stream connection 324 for receiving transmissions of a 
non-indexed data flow (column 3, lines 48-50); 

a client side look-x data stream connection 322 for receiving at leased one non- 
indexed look-x data transmission of the data flow (column 3, lines 48-50, indexing is 
preformed via display organizer 508 located within user terminal 102, column 4, lines 
1 3-26, column 6, lines 6-1 8), 

a client side controller adapted to index at least one point of the look-x data 
stream to at least one corresponding point in said dataflow by summarizing the look-X 
data stream (organizer 508 creates the index locally from time stamped data for the 
corresponding temporal snapshots, column 4, lines 13-26. 43-58, column 5, line 56- 
column 6, Iine18) and generating for display the at least one look-x point to represent 
the at least one corresponding point in said data flow (figures 6a/b, column 4, line 43- 
65), and 

a display 216 (figure 2, figure 6a) for displaying at least one of the indexed look-x 
data points. 

Yeo fails to teach on the fly indexing. 

Yao discloses a client side indexing system which records the position in a 
program where a user has indicated playback, stop or shifting in time forwards or 
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backwards, and later presents these points to the user in order to easily navigate the 
program (column 4, lines 1-67, column 22, line 1-50, figures 25-27). 

Therefore, it would have been obvious to one skilled in the art at the time of 
invention to modify Yeo to utilize the client side on the fly indexing as taught by Yao, for 
the advantages of making it easy to navigate through a video stream based off a users 
past behaviour. 

With regards to claim 13, the claimed select button for providing a user the 
capability to select at least one of the indexed points enabling display of the data flow to 
begin and the selected indexed point is met by column 4, lines 52-58, wherein Yeo 
teaches the ability for a user to control the playback and select the source frames to 
view based on the temporal snapshots. 

Regarding claim 15, Yeo discloses a method for client-side navigating and 
indexing comprising: 

a client side main data stream connection 324 for receiving transmissions of a 
non-indexed data flow (column 3, lines 48-50); 

a client side look-x data stream connection 322 for receiving at least one non- 
indexed look-x data transmission of the data flow (column 3, lines 48-50, indexing is 
preformed via display organizer 508 located within user terminal 102, column 4, lines 
1 3-26, column 6, lines 6-1 8), 
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on the client side an index, tlie index comprising a least one look-x data point to 
at least one corresponding point in said dataflow (organizer 508 creates the index 
locally fronfi time stamped data for the corresponding temporal snapshots, column 4, 
lines 13-26, 43-58. column 5, line 56-column 6, Iine18) and, 

providing control of a playback position of said data flow based on the indexed 
points in the look-x data stream (figures 6a/b, column 4, line 43-65). 

Yeo fails to teach on the fly indexing. 

Yao discloses a client side indexing system which records the position in a 
program where a user has indicated playback, stop or shifting in time fonwards or 
backwards, and later presents these points to the user in order to easily navigate the 
program (column 4, lines 1-67, column 22, line 1-50, figures 25-27). 

Therefore, it would have been obvious to one skilled in the art at the time of 
invention to modify Yeo to utilize the client side on the fly indexing as taught by Yao, for 
the advantages of making it easy to navigate through a video stream based off a users 
past behaviour. 

3. Claims 6-9, 14, and 16-18 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Yeo (US Pat. No. 6,71 1 ,741 ) in view of Yao (US Pat. No. 6,721 ,490) 
in view of Ceccarelli (US Pat. No. 6,222,532), 
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With regards to claims 6 and 14, Yeo, in combination with Yao teaches all of that 
which is discussed above with regards to claim 1 . Yeo does not expressly disclose that 
the second connection is a low resolution connection relative to the main connection. 

Ceccarelli discloses a system in which the provider (or server) can label 
keyframes before transmission to the client, in order to allow the client easy access to 
the chosen keyframes (column 1, lines 18-27). While Ceccarelli does not specifically 
state the use of two connections to the server (one for main video and one for the 
keyframes), he does, however, make a realization that "video distortions in relatively 
smallish keyframes have been experienced as tolerable, [and that] if a particular 
keyframe is enlarged, extra measures should be taken for picture improvement" 
(column 2, lines 4-7). This indicates an inherent understanding that the keyframes are 
often times transmitted as lower resolution images and will need some processing in 
order to display them at higher resolution requirements. Therefore, it can be 
understood that the lower resolution keyframes could be used and downloaded over a 
second lower resolution connection (the connection taught by Yeo). 

It would have been obvious to one of ordinary skill in the art at the time of the 
invention to combine the low resolution connection, as described by Ceccarelli, into the 
combined system of Yeo and Yao, in order to allow for more bandwidth conservation 
and the ability for the user to download more information regarding the keyframes and 
look-x points and not take up massive amounts of bandwidth in the process. 
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With regards to claim 7, Yeo, in combination with Yao teaches all of that which is 
discussed above with regards to claim 1 . Yeo does not expressly disclose any of the 
steps of selecting, displaying, or updating the indexed look-x points. Yeo simply 
discussed the TSG 300 (column 3, lines 18-50), which serves to select and send the 
temporal snapshots to the client. 

Ceccarelli goes into detail about how the keyframes are selected, displayed, and 
updated. The claimed step of selecting a predetermined number of indexed look-x 
points is met by Figure 5, which shows a display of nine keyframes for selection by a 
user. Nine keyframes is more or less just a suggestion and could presumably be 
modified to select any number of keyframes as predetermined by the system. The 
claimed step of displaying the predetermined number of indexed points to provide 
reference for a playback control mechanism is met by Figure 5 again, which shows the 
typical display to the user with nine keyframes being selectable and referencing different 
portions within the video to allow for playback control. The claimed step of updating the 
selected predetermined number of index look-x points based on an update criteria is 
met by column 4, line 67 - column 5, line 3, wherein Ceccarelli teaches that the display 
is updated as the video progresses. The update criteria are based upon a distance 
from the current position. 

At the time of the invention, it would have been obvious to one or ordinary skill in 
the art to include the selecting, displaying, and updating steps as taught by Ceccarelli 
into the system as taught by Yeo in combination with Yao, in order to allow the user to 
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see pertinent keyframes and allow them to view keyframes in the near future and recent 
past. 

With regards to claim 8. Yeo, Yao and Ceccarelli teach all of that which is 
discussed above with regards to claims 1 and 7. Yeo does not expressly disclose any 
step of selecting a predetermined number of look-x points such that each of the look-x 
points is within a predetermined distance of a first play position of the data flow. 

Ceccarelli inherently teaches that the number of keyframes on the display fall 
within a predetermined distance of the play position of the video. It is disclosed on 
column 4, lines 53-58, that the keyframes are located within seconds of each other, with 
the center keyframe being the currently displayed video segment. Therefore, Ceccarelli 
inherently shows that the keyframes that are currently displayed are within a 
predetermined time, and therefore distance of the play position. 

At the time of the invention, it would have been obvious to one of ordinary skill in 
the art to combine the inherent teachings of Ceccarelli, as discussed here, with the 
system as taught by Yeo and Yao, in order to allow the user to see pertinent keyframes 
and allow them to view keyframes in the near future and recent past. 

With regards to claim 9, Yeo, Yao and Ceccarelli teach all of that which is 
discussed above with regards to claims 1 and 7. 
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Yeo does not expressly disclose that the aforementioned update criteria 
comprise a change of the playback position a predetermined amount from the first play 
position during the selection step. 

Ceccarelli discloses a way of updating the keyframes (column 4, line 67 - 
column 5, line 3) and the idea of having the currently viewed video segment and Its 
related keyframe in the center and past and future keyframes to the left and right, 
respectively. In other words, Ceccarelli discloses a dynamic display, which updates 
according to the currently viewed video segment. At the time of the invention, it would 
have been obvious to one or ordinary skill in the art to implement the updating criteria of 
Ceccarelli with the system of Yeo and Yao, in order to allow for a dynamically updated 
display of pertinent keyframes in the near future and recent past. 

Regarding claim 16, Yeo discloses a method for client-side navigating and 
indexing comprising: 

Opening a client side main data stream connection 324 to receive a main video 
stream (column 3, lines 48-50); 

Opening at least another a client side connection 322 to receiving at least one 
look-x data stream of the main video stream (column 3, lines 48-50, indexing is 
preformed via display organizer 508 located within user terminal 102, column 4, lines 
13-26, column 6, lines 6-18), 

on the client side an index, the index comprising a least one look-x data point to 
at least one corresponding point in said dataflow (organizer 508 creates the index 
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locally from time stamped data for the corresponding temporal snapshots, column 4, 
lines 13-26, 43-58, column 5, line 56-column 6, Iine18) and, 

providing control of a playback position of said data flow based on the indexed 
points in the look-x data stream (figures 6a/b, column 4, line 43-65). 

Yeo fails to disclose generating at least one key frame on the client side, display 
of a keyframe, and updating the generating and displaying steps to keep pace with a 
general speed of playback of the main video data stream and on the fly indexing. 

Yeo fails to teach on the fly indexing. 

Yao discloses a client side indexing system which records the position in a 
program where a user has indicated playback, stop or shifting in time fonwards or 
backwards, and later presents these points to the user in order to easily navigate the 
program (column 4, lines 1-67, column 22, line 1-50, figures 25-27). 

Therefore, it would have been obvious to one skilled in the art at the time of 
invention to modify Yeo to utilize the client side on the fly indexing as taught by Yao, for 
the advantages of making it easy to navigate through a video stream based off a users 
past behaviour. 

The combination of Yeo and Yao Yeo fails to disclose generating at least one key 
frame on the client side, display of a keyframe, and updating the generating and 
displaying steps to keep pace with a general speed of playback of the main video data 
stream. 

Ceccarelli goes into detail about how the keyframes are selected, displayed, 
and updated. The claimed step of selecting a predetermined number of indexed look-x 
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points is met by Figure 5, which shows a display of nine keyframes for selection by a 
user. Nine keyframes is more or less just a suggestion and could presumably be 
modified to select any number of keyframes as predetermined by the system. The 
claimed step of displaying the predetermined number of indexed points to provide 
reference for a playback control mechanism is met by Figure 5 again, which shows the 
typical display to the user with nine keyframes being selectable and referencing different 
portions within the video to allow for playback control. The claimed step of updating the 
selected predetermined number of index look-x points based on an update criteria is 
met by column 4, line 67 - column 5, line 3, wherein Ceccarelli teaches that the display 
is updated as the video progresses. The update criteria are based upon a distance 
from the current position. 

At the time of the invention, it would have been obvious to one or ordinary skill in 
the art to include the selecting, displaying, and updating steps as taught by Ceccarelli 
into the system as taught by Yeo and Yao, in order to allow the user to see pertinent 
keyframes and allow them to view keyframes in the near future and recent past. 

Regarding claim 17, Ceccarelli is relied upon to teach updating continuously 
(column 4, line 67 - column 5, line 3). 

Regarding claim 1 8, Yeo is relied upon to teach the use of a look-x data stream, 
Ceccarelli shows in figure 6 a number of key frames, which are for forwards, and 
reverse of the current playback position. Ceccarelli Is further relied upon to teach 
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transmitting new updates (column 4, line 67 - column 5, line 3) and low resolution 
moving snaps near the current playback position of the main video stream (figures 5-6, 
column 2, lines 4-7). See the discussion with respect to claims 6/14. 

Conclusion 

Applicant's amendment necessitated the new ground(s) of rejection presented in 
this Office action. Accordingly, THIS ACTION IS MADE FINAL. See MPEP 
§ 706.07(a). Applicant is reminded of the extension of time policy as set forth in 37 
CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 CFR 1 .136(a) will be calculated from the mailing date of 
the advisory action. In no event, however, will the statutory period for reply expire later 
than SIX MONTHS from the date of this final action. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Hunter B. Lonsberry whose telephone number is 571- 
272-7298. The examiner can normally be reached on Monday-Friday during normal 
business hours. 
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If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, John Miller can be reached on 571-272-7353. The fax phone number for 
the organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 
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